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> One hundred and twenty-four high school students were 

randomly assigned to four groups: 33 subjects memorized the rule 
statement before, 29, subjects memorized the rule statement during, 
and 30 subjects memorized the rule statement after instruction in 
rule application skills. Thirty- two subjects were not required to 
memorize rule statements. Neither memorization nor temporal placemen^ 
of the memorization tasks significantly affected performances on 
posttest or rule .application retention test. Memorization of rule 
statem.ents after mastering rule-governed behavior increased the 
relationships between several performance measures and reasoning , 
ability test scores. Hemori.zation of rule statements prior to rule 
applitration instruction facilitated acquisition of rule-governed 
behavior and reduced variability in students* performance during 
acquisition of rul^ application skills. (Author) 
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^ EFFECTS OF MEMORIZATION OF RULE STATEMENTS ON ACQUISITION 
AND RETENTION OF RULE-GOVERNED BEHAVIOR 
Though intellectual skills such as rule applicatiion skills are more 
resistant to forgetting as compared with lower order intellectual $kil1s 
and verbal information (Lahey, 1941; Gagne and Bassler, 1963) tHfL^ack of 
performance on retention tests in school -learned subjects has been noted 
(Layton, 1932; Lahey, 1941; Pressey, Robinson, and Harrocks, 1§59). Be- 
cause rules are highly resistant to forgetting, the inability to correctly 
apply a rule in a retention task can be attributed to lack of retrieval of 
the correct rule rather than not having stored the rule in memory (Bruner, 
1961). 

Several educational psychologists In designing instructional programs 

/ 

for rule learning have included a requirement for the student to learn the 
rule statement. Gagne (1970) would require the student to make a verbal 
statement of the rule after having mastered the appropriate rule applica- 
tion skills. Evans, Homme, end Glaser (1962) would require the student 
to correctly complete an incomplete rule statement within the rule appli- 
cation instructional program. Merrill (1972) would also require the stu- 
dent to. learn the rule statement within the application skills instruction. 
Being able to repeat the rule statement from memory would allow the student 
to talk about the rule on a later occasion (Gagne, 1970) and may serve as a 
valuable cue for subsequent application of the rule (Merrill, 1972). 

The findings of two research studies investigating the role of verbal- 
1,^ing rules during acquisition of rule application skills aro inconclusive. 
Gagne and Sn)th (1962) reported that S_s who were instructed to say aloud 
their reasons for making each step in the solution to a practice problem 



reached a correct solution for the final task in fewer attempts than did 
Ss who were not required to verbalize. This difference increased as the 
problems became more difficult. In addition, those Ss' who were required 
to verbalize their reasons for each problem solution step were able to 
formu^ e general principles of problem solution after correctly solving 
the I ,al task problem bettter than those Ss not required to verbalize 
during the practice attempts. Results of the Seidel-Rotberq (1966) study 
showed that the students who were required to give back the rules in the 
words of the instructor (in this case, the instructional program) during 
the course of learning computer programming also were able to do this 
quite well on a criterion test. Further results ir^dicated that these 
subjects did not do as well in writing computer programs on the criterion 
test as subjects who had simply to write the names of the rules during the 
training or subjects who learned without either additional requirement. A 
retention test involving the application of concepts learned during the 
instructional program in writing computer programs showed no statistically 
significant difference among the three groups. 

The purpose of the present study was to investigate the effects of 
memorization of rule statements on acquisition and retention of rule-governed 
behavior in a computer-based, criterion referenced instructional task. 

Method 

Subjects 

The subjects were 124 students in the Florida State University Develop- 
mental Research School selected randomly from grades 9-12. 
Instruments 



A series of studies by P. F. Merrill and his students (Merrill, 1970; 
Merrill, et al., 1972; 1973) have produced results showing Aptitude 



Treatment Interactions (ATI's) in a rule-learninq task similar to that 
used in this study. Following the results of the P. F. Merrill studies, 
the Letter Sets Test froni the Kit of Reference Tests for Cognitive Fac- 
tors (French. Ekstrom, and Price, 1963) was selected as a measure of 
inductive reasoning. The Ship Destination Test from the same source was 
selected to measure general reasoning. 

The learning task used in this study was an adaptation of materials 
based on the APL programming ' language used in several previous studies 
(Merrill, et al . , 1972; 1973). The learning task consisted of five 
modules, each based on one APL rule. Each module consisted, depending 
upon the group assignment, of a rule statement, examples of correct appli- 
cation of the rule, problems to which the rule must be applied to compute 
the correct ar.swer, and a requirement to memorize the rule statement. The 
results of previous research show the first three rules relatively easy 
and the fourth and fifth rules substantially more difficult for Ss to 
learn. 

The instructional program was written in the Coursewirter II language 
and presented to the subjects by the IBM 1500/1800 computer-assisted instruc- 
tional system at the FSU CAI Center. The learning materials and all tests 
in the APL-based instructional program were presented on the 1510 cathode 
ray tube (CRT). 
Procedure 

The study was administered in three sessions including an ability 
testing session, the instructional task and posttest session, and the re- 
tention test session. The ability tests were administered to all subjects 
in one large group session and in one smaller group session, necessitated by 
the confines of the University School schedule. Immediately preceding the 
administration of the tests, a short explanation of the general purpose and 



schedule of the study was given to the subjects. The ability testing 
session (paper ana pencil) lasted for about one hour. 

The instructional task session was presented by the CAI system in 
the FSU CAI Center. The subjects were randomly assigned to four groups. 
The four groups were a No Memorization of rule statement group (N=32), 
a Rule Statc-nient Meiiiorization Prior to instruction group (N=33), a Rule 
Statement Memorization During instruction group (N=29), and a Rule State- 
ment Memorization After instruction group (N=30). Before receiving in- 
struction in learning the APL rules, all Ss were presented with warm-up 
materials designed to familiarize each S with the operation of the terminal 
and to indicate in advance of the presentation of the experimental materials 
what was expected of him during the instructional program. 

tach of the five modules of the rule application instructional program 
presented to all groups consisted of three levels of instruction in rule 
application skills. The student was required to meet the minimum criterion 
performance of two-thirds of the rule application problems correct on each 
level before moving to the next level. The supporting stimuli of the rule 
statement and accompanying examples were faded from one level to the next 
until the criterion performance consisted of the presentation of a problem 
for which S was required to compute the correct answer without the aid of 
supporting stimuli. If t; .: student did not meet the minimum performance 
requirement of two problems correct out of the three that were presented at 
any one level, hn received up to four additional displays of that level. 
When criterion was reached at each of the three levels of rule application 
instruction,' S^s then received the instructional module for the next task 
which d.-pended upon the group to which S_ was assigned. The modules were 
presented randomly until all five rules were learned. 
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This basic sequence of instructional tasks was presented to all Ss 
with the following exceptions. The Rule Statement flemorization Prior 
grbup was required to menorize the rule statement prior to receiving 
instruction in application of the rule. The Rule Statement Memorization 
During group was required to memorize the rule statement after reaching 
the criterion of two-thirds correct of the problems presented in the first 
level of rule application instruction. The Rule Statement Memorization 
After group was required to memorize the rule statement after meeting 
criterion on all levels of application problems associated with the rule. 
The No Memorization group was not required to memorize the statement of 
the rule. 

The rule statement memorization instruction consisted of several 
levels of requirements on the part of the Ss to complete a rule statement 
by typing the appropriate words using the terminal keyboard. The support- 
ing stimuli of partial rule statements and examples were faded until the 
criterion performance consisted of the presentation of a partial example, 
for which S was required to type the statement of the correct rule to be 
apolied. A posttest consisting of three problems for each APL rule was 
administered to each S immediately after completion of the instructional 
task. 

Two weeks after the instructional session the subjects returned to 
' the CAI Center to receive administration of the rule application retention 
test and the rule statement retention test. 
Dependent Measures 

In addition to scores on the two cognitive ability tests, posttest, 
and retention test, data were obtained for each S during the rule application 
instruction program on the following criteria: display latency, sample 



7 



tost item response latency, and number of sample test items attempted 
before ineotincj the ininiir.um performance criterion required by the program. 
Display latency was the measure of the time between the initial display of 
study material and the start of the display of the first problem of that 
level of instruction. Sample test item response latency was the time be- 
tween the initial display of a test item and the answering of that test 
item imbedded within the rule application instruction. 

Data were also collected on the total amount of time required for 
each S to complete the instructional program including the ruTe statement 
memorization instructional materials. This total instructional time did 
not include the time required for testing activities. 

• Results and Discussion ' 
A summary of mean percentage correct on the ability tests and on the 
task performance tests is presented in Table 1. All groups performed 
similarly on each test with the exception of the rule statement retention 
test where, as would be expected, the group that was not required to memo- 
rize rule statements performed less well than the rule statement memoriza- 
tion groups. All groups performed at a higher level on the rule application 
posttest than was required within the instructional program— 81-88% on the 
posttest as compared to 67% required in the instructiona> program. Perform- 
ance of rule-governed behavior on the rule application retention test was 
somewhat lower than that on the posttest but substantially higher than that 
on the rule statement retention test. This result is consistent with 
results of previous research indicating that Intellectual skills such as 
rule-governed behavior are more resistant to forgetting than memorized 
verbal information (Lahey, 1941; Layton, 1932; Gagne and- Bass! er, 1963). 
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Analysis of variance £ ratios for the instructional task test scores are 
also reported in Table 1. 



Insert Table 1 about here 



Since the experii;:cntal procedure required all Ss to perform at a 
inininiuiii criterion level on each rule module before proceeding to the next, 
no significant treatment differences were expected in mean posttest scores. 
The results from ANOVA suggest that the minor difference in treatment group 
posttest means was due to chance. Similarly, the differences in treatment 
group rule application retention test means were not statistically signifi- 
cant. However, linear regression analyses revealed significant ATI's using 
posttest scores and rule application retention test scores as criterion 
variables with Ship Destination Test as covariable. Figure 1 illustrates 
the relationship between the reasoning ability test scores and rule applica- 
tion retention test scores for each treatment group. The regression lines 
plotted with posttest scores as criterion had a similar relationship as 
those in Figure 1. The greater positive relationship between reasoning 
scores and performance test scores in the Rule Statement Memorization After 
group is somewhat surprising as the instructional program for learning rule- 
governed behavior was the same for the Rule Statement Memorization After 
group as for the No Memorization group. Yet, the relationship between 
reasoning ability and posttest performance was greater for Ss in the Rule 
Statement Memorization After group than for Ss in the No Memorization group. 
Apparently the requirement of memorizing a rule statement after having 
mastered the behavior required by the rule increases the Yelationship be- 
tween reasoning ability and test performance as compared to not being 



required to memorize the rule statement at all. 



Insert Figure 1 about here 

The rule statement retention test r^rquired each S to type the state- 
ment Of the rule that would be used to compute the correct answer to each 
of five problems, each problem representing one of the previously learned 
APL rules. The^e statements were evaluated independently by two expert 
APL programmers, A correct rule statement was awarded 10 points with 
fewer points being given for partially correct answers. The product moment 
correlation between the total scores awarded each S .by the two evaluators 
was .94 which indicated a high degree of scoring consistency between 
evaluators. For purposes of further analysis, the average of the two total 
scores for each S was used. As reported in Table 1, analysis of variance 
revealed < significant treatment effect. Subsequent t_ tests revealed 
no signif cant mean performance differences between the three rule 
statement memorization groups, or between the Rule Statement Memorization 
During group and the No Memorization group. However, mean scores indicated 
significantly lower scores for Ss in the No Memorization group than Ss in 
the Rule Statement Memorization Prior group (t = 2.39, df. = 120, £ < .05) 
and for Ss in the Rule Statement Memorization After group (t » 2.79, df; = 120, 
£ < .05) . 

Though S^s in the No Memorization group were not required to memorize 
rule statements at any time, their performance on the rule statement reten- 
tion test did indicate that they could give minimally correct rule statements 
two weeks after rule application instruction. Surprisingly, the performance 
of Ss in the Rule Statement Memorization During group was not significantly 
different from that of S.s in the No Memorization group. All Ss who memorized 
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t;-.o rule statonts durinq rulo ;iu-)pi ication instruction did, in fact, memorize ; 
the rule stateiv-onts just as thoroughly as Ss in the other two rule statement 
moiaorization groups out at a different point in the total instructional 
program. The interruption of rule application instruction to fulfill the 
rule stat.^ir,ent nieir.ori zaiion requirement and then the subsequent return to 
the rule application instruction seems to have debilitated Ss' ability to 
restate the rule state;v.ent on the retention test. 

The effect of memorization of rule statements on the acquisition of 
rule-governed behavior is shown by analysis of the following dependent 
measures. 

The number of sample test items attempted during the rule application 
instruction is a gross measure of. the subject's performance in the instruc- 
tional program. The number of sample test items required to meet the 
minimum performance criterion is directly related to difficulty S had in 
mastering the instructional materials. The minimum number of sample test 
items that any S would have received was 45--three for each of three 
levels of the five rule modules. Of great interest are the standard devia- 
tions of the Rule Statement ^iemorization Prior group (See Table 2). The 
instructional program presented to Ss in this treatment group produced rule- 
governed behavior so uniformly good that the variability was reduced to the 
point where analysis of variance on this data might be considered to be 
inappropriate. The range of number of sample test items attempted by Ss 
in the Rule Statement Memorization Prior group was 45-57 with a mean of 
46.6. The ranges of sample tes't items for the No Memorization group, the 
Rule Statement Memorization During group, and the Rule Statement Mem.orization 
After group v;ere 45-141 , 45-123, and 45-115 rispectively. From this evidence 

it would seem safe to conclude that rec;uiring memorization of rule statements 

i 
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prior to rule application instruction is the best of the four instructional 
strategies to facilitate uniformly good rule-governea behavior with a minimum 
number of practice test Jte:;;s. . . 



Insert Table 2 about here 



Linear regression analysis was employed to probe for possible ATI 
effects on the nuir.ber of rule appl i cation sample test items attempted. 
Ficure 2 illustrates the significant interaction between Treatment and 
Ship Destination Test scores using number of sample test items as criterion 
wher,e number of sample test items has a high negative relationship to 
general reasoning ability for Ss in the Rule Statement Memorization .After 
group. This relationship is also present for Ss in the other groups but 
to a lesser degree. In fact, this relationship was substantially reduced 
for Ss in both the No Memorization group and the Rule Statement Memoriza- 
tion Prior group. The similarity in slopes of the regression lines for 
the latter two groups should be interpreted in light of the substantial 
difference in treatment group means whereby the instructional program for 
the Rule Statement Mem.orization Prior group reduced the mean num.ber of ^ 
sample test items required to meet the minimum performance criterion re- 
quired of all Ss in rule-governed behavior. 



Insert Figure 2 about here 



Another dependent measure used as an indication of Ss' performance in 
the instructional program is display latency. The amount of time that' the 
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instructional materials are displayed is directly related to the difficulty 
S had in learning rufo-govern^d behavior. As would be expected, mean dis- 
play latency increased, from about 30 seconds for each of the three 
previously demonstrated easier rule modules to about three minutes for each 
of the two more difficult, rule modules (See Table 3). The instructional 
program which required Ss to memorize rule statements prior to receiving 
instruction in rule-gt)verned behavior facilitated learning of rule 
application skills such that it produced uniformly low requirements for 
study time as compared to the instructional programs for the other treat- 
ment groups. When display latency for each of the five rule modules was - 
totaled, the tot^l display latency variance for the Rule Statement Memo- 
rization Prior group was significantly less than the variance for the No Memori 
"^tion group (F = 5.42. df = 31/32, £< .01). the Rule Statement Memoriza- 
tion During group (F = 2.27, df =: 29/32, £ < .05). and the Rule Statement ^ 
Memorization After group (F ^ 2.84, df = 28/3^ £ < .01). Though the 
measure of display latency is not 'as important as other measures reported . 
in this paper, these results do give further evidence as to the effective- 
ness 0^ the instructional program for the Rule Statement Memorization 
Prior group in facilitating the acquisition of rule-governed behavior. 



Insert Table 3 about here 



One additional measure used to indicate Ss' performance wi thin the 
instructional programs is the amount of time S takes to respond to the 
sample 'test items. Although this measure was highly related to the number 
of sample t^st items attempted (product moment correlation of .72). it 
does give additional information of the effectiveness of the instructional 
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pro5rair,s. Consistent with me resu.ts-of the analyses of several other 
dependent measures, the instructional program fo^ the Rule Statement 
Memorization Prior group significantly reduced variability in total test 
item response latency as compared with the programs .for th^NoxMemorization 
group (F = 7.7, 'df = 31/32, £< .01), the Rule Statement Memorization During 

•group (F = 5.03, df = 29/32, £< .01), and the Rule Statement Memorization 
After group (F = 6.42, df = '28/32, £ < .01). As depicted in Table 4 tne- 
mean sample test item response latency for Ss in the Rule Statement Memori- 
zdtion Prior group was consi stentl^ less than that for each of the other 
three groups on each rule module. Mean total sample test item response 

'latency indicated less time necessary to respond to test items for Ss in the 
Rule Statement Memorization Prior group than for Ss in the No Memorization 
group (t = 3.502, df = 63, £ < .05), and Ss in the Rule Statement Memori^ 
zation During group ( t = 3.168, df = 61, £< .05). Although not signifi- 
cant at the alpha level of .05, the difference between performance of 
Ss in the Rule Statement Memorization Prior group and Ss in the Rule State- 
ment Memorization After group (t = 1.67, df = 62. £ .10) was in the same 

. direction vsiith Ss memorizing rule statements prior to rule application in- 
struction requiring less time to respond to the sample test Items imbedded 
in the rule application instruction materials. 



Insert Table 4 about here 



The total time, excluding testing time, required by each S to complete 
the instructional program,' including both the sections on rule application 
and on rule statement memorization, was recorded as a measure of the 
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overact 1 efficiency of the total program. Mean times for the No Memoriza- 
tion yroup* tho :^ule StatomGHt Memorization Prior group, the Rule Statement 
Memorization During gro^, and the Rule' Statement Memorization After group 
were 21, 53, 60, and 50 minutes respectively. Jhe rule statement memoriza- 
tion groups required substantially more time to complete the instructional 
program than did the group not required to menorize rule statements. As the 
three rule statement memorization groups not only mastered rule-governed 
behavior but also performed the additional task of memorizing the rule state- 
ments, this finding is not at all surprising. " ' 

Conclusions and Implications ( 
The results from both the posttest and the rule application retention 
test clearly show that memorization of rule statements is not necessary for 
acquisition and retention of rule-governed bejiayior in a forced mastery 
learning situation. On the other hand, rule statement memorization was not 
detrimental to performance on the posttest as was the case in the Seidel- 
Rotberg study. 

It is also clear that memorizing rule statements before rule applica- 
tion instruction occurs does facilitate acquisition of rule-governed behavior 
and reduces variability in the performance of students during this acquisition. 
As desirable as this effect is instructionally , it must be tempered with the 
fact that memorization takes a substantial amount of time. In this light, 
if instructional time is at a pcemium, students probably should not be re- 
quired to memorize rule statement:- ' 

It is not possible from the results of this study to explain the unusual 
effect of increased relationships between performance on several dependent 
measures and reasoning ability test scores in Ss who memorized rule state- 
ments after meeting criterion in the rule application skills. This effect 
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should be investigated further to determine if it is caused by nemortaation 
of rule statements or if nieniorization of any statement unrelated to the 

^application of the rule would have the same effect. 

• Implications of these findings for instructional practices could be 
summed up as follows. (1) If memorization of a rule statement is required 
in an instructional program designed to teach rule application skills, the 
memorization requirement should be fulfilled prior to instruction in rule 
application skills. (2) If the goals of an instructional program are 
associated with only rule-governed behavior in long-or short-term retention 
situations, memorization of rule statements is not necessary. (3) If total* 
instructional time is limited and all instruction must take place during 
this time, memorization of rule statements should not be included in the 
instructional program. (4) If some goals of an instructional program • 
are associated with facilitating performance during the acquisition of 
rule-governed behavior, memorization of rule statements should be required 

^prior to instruction in rule application skills. (5) If' one purpose of , 
the instructional program is to reduce learning errors and accompanyint) , 
frustration and/or anxiety, memorization of rule statements should be 
requtred prior to Instruction on rule application skills. 

/ 
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